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Abstract. Let B be the Bergman projection associated to a do- 
main fi on which the 9-Neumann operator is compact. We show 
that arbitrary L 2 derivatives of Bf are controlled by derivatives 
of / taken in a single, distinguished direction. As a consequence, 
functions not contained in C°° (fi) that are mapped by B to C°° (fi) 
are explicitly described. 



1. Introduction 

The purpose of this paper is to prove a refined global regularity 
property of the Bergman operator associated to a pseudoconvex domain 
in C ra on which the <9-Neumann operator is compact. 

Let Q C C n be an open connected set with smooth boundary, bfl. 
If 0(0) and L 2 (Q) denote the spaces of holomorphic functions and 
Lebesgue square-integrable classes on Q, elementary estimates show 
that the Bergman space A 2 (Q) = 0{Q) fi L 2 (Q) is closed in L 2 (Q). 
Consequently, the orthogonal projection B : L 2 (Q) — > A 2 (Q) is a well- 
defined bounded operator on L 2 (Q). The operator B is the Bergman 
projection. 

A problem of significant interest is to understand the behavior of 
B on function spaces other than L 2 (Q). Since B generally lacks a 
simple closed-form expression as an integral operator, there cannot be 
a universal resolution to this problem. However, special cases have 
been widely studied and there are numerous results connected to this 
problem, for different classes of domains Q and for different function 
spaces F; see © 1201 CD UM EH El QH M, E] and their references for the 
principal cases known. The function spaces considered in these works 
are naturally graduated, e.g., Lipschitz spaces, Sobolev spaces, and the 
conclusion is that B is a "Oth order operator" on the graded family of 
Banach spaces considered, i.e., B maps F s to F s , preserving but not 
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improving the scale s within the family {F 1 }. This is a sharp isotropic 
conclusion since Bh = h for h G A 2 (Q) and A 2 (Q) contains elements 
sharply in the classical spaces F s . 

There is however a basic non-isotropy inherent to the analysis of 
0(p) which can lead to sharper boundedness results. This non-isotropy 
arises from the partial complex structure of T(bfl), the tangent space 
to bfl, and goes back to the beginning of complex analysis in several 
variables (e.g., pseudoconvexity, Hartogs phenomena). The observa- 
tion that this non-isotropy can lead to sharper boundedness results 
for B and related operators, however, originates in the work of Stein 
[221 [21] • Subsequently, this fundamental observation has been devel- 
oped, extended, and applied to a variety of problems in several com- 
plex variables by many mathematicians; see [H [22] and the references 
to chapters XII and XIII in [25] . 

In this paper, we consider a simple, global aspect of the analysis 
of B that seems to have been overlooked. Suppose that Q C C n is a 
smoothly bounded domain on which the <9-Neumann operator, N, is 
compact. Under this hypothesis, Kohn and Nirenberg (Theorem 2 in 
[Hj) showed that N is globally regular and that B is globally regular as 
well, i.e., B maps C°°(Q) to itself. More quantitatively, Kohn showed 
in §2 of [12] that for any k G N there exists a constant > so that 



where ||.||fc denotes that L 2 Sobolev norm of order k on Q. The goal 
of our paper is to improve (11 .11) by showing that the full H k norm on 
the right hand side can be replaced by a term involving derivatives of 
/ in only one special direction (up to order k). Specifically, suppose 
Q = {z G C n : r(z) < 0} for a C°° function r such that Vr / on 
{z G C™ : r(z) = 0} and define the vector field 



Let X l f = X(X(. . . (Xf) ...) denote Mold differentiation of / by the 
vector field X. The main result of this paper is 

Theorem 1.3. Let Q C C™ be a smoothly bounded, pseudoconvex do- 
main on which the d-Neumann operator is compact, r a smooth defining 
function for Q, and X the vector field in (jl.2p . 

Then for any k G N there exists a constant > such that 



(1.1) 



V / G H k (tt) 



(1.2) 




k 



(1.4) 
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holds for all f G L 2 (Q) such that X l f (in the distributional sense) 
belongs to L 2 (Q), £ G {1, . . . , k}. 

The improvement over (II -ip given by Theorem II .31 can be illustrated 
already on the unit disc D in C, D = {z G C : \z\ < 1}. Let 

f{z) = {l-\z\ 2 )^-g{z) 

for a fixed g G C°°(D), which does not vanish identically on bD. Then 
/ G L 2 (D) and Xf = (1 — |z| 2 )~ 3 • Xg, since X is tangent to bD, is 
also in L 2 (D). However, / ^ H l (D) since 

±.f~(l-\z\*)-\.gtL*{p), 

where denotes the radial derivative on D. Theorem 11.31 implies that 
Bf belongs to H 1 (D), but this cannot be concluded from (11.11) . 

The proof of Theorem 11.31 will occur in two basic steps. Both steps 
involve the non-isotropy of (D(Q) mentioned above, but in different 
ways. The first step is to show 

k 

(1.5) \\h\\ k <C k J2\\X £ hl heO(Q). 

e=o 

This is a well-known fact, see, e.g., [2j[3], that follows from the elliptic- 
ity of the Cauchy-Riemann equations and does not require hypotheses 
on Q other than the smoothness of bQ (which can also be weakened, [2]). 
Inequality (I1.5P reduces establishing (II. 4p to bounding Y^l=o 11-^-^/ 1 1 
by the right hand side of (ll.4p . We emphasize that no properties of 
the Bergman projection beyond the fact that Bf G 0(Q) are used in 
this step. 

The second step is to see how X commutes with In this step, the 
orthogonality of B and the hypothesis that the <9-Neumann operator iV 
is compact are used heavily. Commuting X directly with the integral 
operator B is intractable because of the lack of useful estimates on 
the Bergman kernel under the hypothesis of Theorem 11.31 Instead, 
Kohn's formula (see (I2.5P ) is used to transfer the problem to estimating 
derivatives of a (0, l)-form ip closely connected to /, <p = Ndf. This 
idea was also used in [H [131 [10] f° r similar reasons. A key point is to use 
Kohn's formula to expand only one side of the inner product ||X5/|| 2 = 
(XBf,XBf). The other essential point is to use Proposition 13.41 of 



1 If is a ball in C", this step simplifies enormously; see the Appendix. 
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Section [3] to re-express derivatives in terms of X; a careful integration 
by parts argument then shows 



defined in Section HI 

The final argument is to show that \\T<p\\ is dominated by 
The crucial estimate used here is the compactness estimate (I2.4p . with 
Proposition 13.41 again used to re-express derivatives of ip as T is com- 
muted past the d and d* operators. The special relationship between 
ip and / (namely, dip = and 8*<p = f — Bf) then allows the proof 
of Theorem 11.31 to conclude for the case k = 1. A careful examination 
of the estimates leading to the case k — 1 gives the result for higher 
derivatives. 

The paper is organized as follows. In Section [2] notation is fixed 
and some elements of the <9-Neumann theory are recalled. In Sec- 
tion |3l basic geometric apparatus associated to the boundary of a 
smoothly bounded domain is laid out and the needed inequalities in- 
volving derivatives in the "bad tangential direction" to the boundary 
are derived. The proof of Theorem 11.31 is then given in Section HI In 
Section the class of functions which is mapped by B to C°°(fi) is 
described and the dependence of (jl.4p on the choice of the vector field 
X is discussed. The section concludes with a description of the class 
of vector fields which may replace X in Theorem 11.31 

We would like to thank Harold Boas for several stimulating conversa- 
tions at the Erwin Schrodinger Institute in the fall of 2009. This project 
started when he suggested that estimates obtained in pi)] should lead 
to improvements similar to Theorem 1 1.31 even for more general domains 
than we consider here. 



Standard coordinates on C n will be denoted (z\, . . . , z n ), with Zk = 
Xk + \f-lyk for k — 1, . . . , n. The usual Cauchy-Riemann vector fields 
are defined 



Differentiation of a smooth function will often be denoted with sub- 
scripts, e.g., f Zj = §£. 

Domains flcC" with smooth boundary bfl will be described using 
defining functions: a smooth, M- valued function r is a defining function 




2. Preliminaries 
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for Q if Q = {z G C n : r(z) < 0} and Vr ^ on {z G C n : r(z) = 0}. 
Note that Y^=i l r ^l 2 7^ on M7 if r defines fl If Q C C n is smoothly 
bounded, and r defines Q, then Q is pseudoconvex if for all z £ bQ 

n n 

(2.1) r ^ k i z Mk > V^eC" with ^r,.( 2 )^ = 

j,fc=i i=i 

holds. 

Throughout the paper, |.| denotes the L 2 (f2) norm and the L 2 
Sobolev norm of order k, k G N, is denoted On functions these 

norms have a standard meaning, but on forms some ambiguity is in- 
volved. If / and g are measurable functions on Q, their L 2 inner product 
is 

(/,»)= / fgdv E 

Jn 

where cIVe denotes the Euclidean volume form (which we usually drop). 
The L 2 norm is then ||/|| = a/ (/, /) and L 2 {Vl) denotes the set of 
such / with ll/H < oo. Also, \\f\\ k = Ei a i= fc P Q /ll where D 



is 



partial differentiation of order determined by the multi-index a, taken 
in the sense of distributions, and H k {Q) denotes all / such that ||/||fc < 
oo. On (0, g)-forms, we declare that elements of the basis given by 
dz^ A • • • A dzi q , i\ < • • • < i q , are (pointwise) orthonormal and define 
|.|| and as above on the components of a form relative to this 
basis. Thus, if a (0, g)-form u is expressed as 

u,j{z)dz , z G U, 

\J\=g 

where J is multi-index of length q, the u/s are functions, and Yl'\j\= q 
means that the sum is taken only over strictly increasing multi-indices, 
we set ||n|| = ^ and \\u\\ k = ^ ll u j||fe- 

From the theory of the <9-Neumann problem, we shall recall only a 
few rudimentary facts needed in the proof of Theorem 11.31 For proofs 
of these facts, and further information about the <9-Neumann problem, 
we refer the reader to [7J [26] . 

The Cauchy-Riemann operator d : A°' q (il) — > A°' q+1 (Vl), defined 
initially on (0, q) -forms whose components belong to C°°(Q), can be 
extended to an operator acting on (0,g)-forms with square-integrable 
components, L\ q (Q). An adjoint operator, d*, to d may then be defined 
using the standard Ll q (Q) inner product. The symbol $ will be used 
to denote the action of d* but as a distributional differential operator; 
in particular, $ can be applied to any element of Lq g (f2). The operator 
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d* comes with a naturally associated domain, Dom(<9*), so that, e.g., 
u ( z ) = YTj=i u j( z ) dzj € A 0,1 (fi) belongs to Dom(<9*) if 

n 

(2.2) ^r Z] (z)uj{z) = V z G bVt 

3=1 

holds. The space A - 1 ^) n Dom(<9*) is denoted by V ' 1 ^). 

The complex Laplacian is defined as Ou = BB*u + B* Bu for those 
u G Dom(<9) fl Dom(<9*) for which Bu G Dom(<9*) and B*u G Dom(<9) 
holds; the set of these forms is denoted by Dom(D). For the purpose 
at hand, only the complex Laplacian on (0, l)-forms is of relevance, so 
that we restrict our considerations to this bi-degree. 

The Dirichlet form associated to the (□, Dom(fJ)) boundary value 
problem, 

Q(u, u) = \\du\\ 2 + \\B*u\\ 2 , 

satisfies the following basic estimate, with a constant independent of 
u, if fl is pseudoconvex: 

2 

<Q{u,u) ViieD - 1 ^) 

where the expression denotes g|- acting on each component of u. 
Inequality (12. 3p implies that the <9-Neumann operator A" : Lqi(^) — > 
Dom(D), satisfying A" o □ = Id\r>om(n) an d □ ° A" = Id, exists and is 
bounded on L^^fl). If A" satisfies the stronger condition that it is a 
compact operator, Kohn and Nirenberg [2] showed that A" preserves 
the class of (0, l)-forms that are smooth up to the boundary. They also 
showed that compactness of A" is equivalent to the following collection 
of inequalities: for every e > 0, there exists a constant C(e) such that 

(2.4) IMI 2 < e Q(u,u) + C(e)|w|_i, Vue^fd) 

holds, where | denotes the ordinary Sobolev norm of order -1 (or any 
norm compact with respect to ||.||). The property that A" is compact 
does not hold on all smoothly bounded pseudoconvex domains, but 
many classes of such domains are known to have this property, see [9]. 

The relationship between A" and the Bergman projection B which 
we will use is expressed by Kohn's formula: 

(2.5) B = Id- B*NB. 

We refer to the inequality 2\ab\ < ea 2 + ^b 2 , a, b G M. and e > 0, as 
the (sc)-(lc) inequality. Also, the expression \a\ < |6| will mean that 



(2.3) 



\u\ 



+E 

/ . — 1 



du 



dz k 
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there exists a constant K > 0, independent of certain parameters (that 
will be specified or clear when used), such that \a\ < K\b\ holds. The 
usual notation for the commutator of two operators A and B is used: 
[A, B] = AB — BA. 

3. Analysis in the bad direction 

The Cauchy-Riemann fields induce a splitting of the complexified 
tangent bundle to C\ CT (C n ) = T (C n ) ® C, written 

CT (C n ) = T 1 ' (C n ) © T 0,1 (C n ) 

where T 1,0 (C n ) denotes the span of {^L,...,^} and T 0,1 (C n ) = 
spanj^-, . . . , The real tangent bundle to 60, T (60), also splits 

via the Cauchy-Riemann structure. Let T 1,0 (60) = T (60) n T 1,0 (C n ) 
and T 0,1 (60) = T (60) n T 0,1 (C n ). Then 

T (60) = T 1,0 (60) © T ' 1 (60) © B 

where £>, satisfying dim K B = 1, is the "bad direction" tangent to 60. 
Note that B is spanned by the vector field X defined in (11. 2p . 
The globally defined vector fields 

n d n d 

i=i J j=l J 

in T 1,0 (C n ) and T 0,1 (C n ) respectively, are transverse to 60 since J\f(r) = 
■A/"(r) = Y^j=i \ r zj\ 2 7^ on 60. For k G {1, . . . , n}, define the vector 
fields 



(3.1) L k = — -x-r Zk M 

and their conjugates L k , where % 6 C°°(0) equals Ej=i l r ^j| 2 ) 1 m 
some neighborhood of 60. 

Proposition 3.2. 

T 1,0 (60) = span{L!,...,L n }. 

Similarly, T 0,1 (60) is spanned by {L^ : k — 1, . . . , n}. 

Proof. Note that L&(r) = for = 1, . . . ,n, so each is tangent 
to 60. Since (13. ip implies that = L k + x ■ r z h N for k = 1, . . . , n, 
the statement T 1,0 (C n ) = span {Li, . . . , L„, A^} is immediate. The fact 
that M{r) 7^ on 60 then yields the claimed statement about T 1,0 (60). 
The statement about T ' 1 (60) is proved analogously. □ 
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A useful frame for all CT(C"), that contains the fields ( 13. ip . may 
also be isolated. 

Proposition 3.3. 

CT (C n ) = span {L 1: . . . , L n , L x , . . . , L n , X, 77} . 
Proof. The proof is similar to Proposition 2.2. □ 

Remark: Note that Propositions 2.2 and 2.3 give more spanning vectors 
than the dimensions of the spaces T 1,0 (bQ) and CT (C n ) require. This 
over-prescription of spanning vectors will simplify some technicalities 
in Section HI 

The following integration by parts result will play a crucial role in 
Section HI 

Proposition 3.4. Let Q C C n be a smoothly bounded domain. Then 
for all g G C 00 ^) and e > 



9\\ 2 



(3-5) £ ll L ^H 2 ~ e ll X ^H 2 + -ll^ll 2 + E ll L ^H 2 + e H r ^ 
i=i 6 3=1 

holds with a constant independent of g. 

Proof. Let L* be the formal adjoint of Lj, j £ {1, . . . ,n}. Then, since 
the L/s are tangential to bQ, integration by parts yields 

n 

J2\\L j9 \\ 2 = J2( L *3 L i9,9) 

3=1 3=1 
n 

~ ^2{\(LjLj9,g)\ + \\L jg \\ ■ \\g\\}, 

3=1 

where the last estimate follows since L* equals —Lj modulo multipli- 
cation by a function in C°°(0). Applying the (sc)-(lc) inequality then 
gives 

n n 

^2\\Lj9\\ 2 \(LjLjg,g)\ 

3=1 3=1 
n 

^J2{\(^ L ^9)\ + \(L j9 ,L*g)\} 

3=1 
n 

~ J2{\(^^ L 3)9,9) \ + \\Ljg\\ ■ \\g\\ + p^|| 2 }- 

3=1 
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Since [Lj,Lj] G T(bQ), Propositions 13.21 and 13.31 imply that [Lj,Lj] = 
a k L k + Yj bkLk + oyX + c 2 rAT. Therefore, 

n / n \ n 

E W L ^f ^ \\*9\\ + Wg\\ + E {fell + fell} • Nl + E fell 2 - 

j=l \ i=l / j=l 

Using the (sc)-(lc) inequality, we obtain for any e > that 

n n 

E fell 2 s e feii 2 + >n 2 + E fen 2 + e ii^n 2 - 

□ 



e 

i=i i=i 



Corollary 3.6. Let Q C C n 6e a smoothly bounded domain. Then: 

(i) For a// a G C°°(n) 

n 

ii«ii?<ii^ii 2 + ii«ii 2 + Eifen 2 + rai 2 

3=1 

holds, where the constant is independent of g. 

(ii) For all h G 0{0) n C°°(fi) 

K<£iw 

holds with a constant independent of h. 

Proof. By Proposition 13.31 any first order derivative can be written as 
a linear combination of AT, X, the L/s and the L/s. An application 
of Proposition 13.41 then completes the proof of (i). 

The case k = 1 of (ii) follows immediately from (i) and h G 0(Q). 
Write D a for |^ for a = («i, . . . , a n ) a multi-index. Then /i G O(O) 
also implies that for given integer k > 1 



< E ii^ii 2 ^ E ii^f + ^iiLi 

ja|<fc |a|=fc 



holds. For given a with \a\ = k choose i such that a, > and set 

a 



a' = (cti, • • • ,aci-i,ai-l,a i+1 , . . .,a n ). Then, since = Li + x-r Zi J\f, 



it follows that 



\D a h\\ 2 = WD^LM 2 < WUD^hW 2 + 
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Part (i) and h G 0(Q) yield 

n 

\\LiD a 'h\\ 2 < \\XD a 'h\\ 2 + \\D a 'h\\ 2 + J2\\LiD a ' h\\ 2 + H^"'^!! 2 
(3.7) <\\XD a 'h\\ 2 +\\h\\l_ 1 . 

Repeating the arguments leading up to (13.71) ctj-times for all aj gives 

l«<ElW + K-i- 

1=0 

The claimed inequality (ii) now follows by induction on k. □ 

4. Proof of Theorem 11.31 

The following spaces of Sobolev type occur in the conclusion of The- 
orem [T_3J 

Definition 4.1. LetQ C C n be smoothly bounded, r a defining function 
for ft, and X the vector field given by (II. 2p . 
Define, for k G N, 

H x (tt) = {f G L 2 (fi) : XVfas a distribution) G L 2 (£l),j G {1, ...,&}} . 

For fixed fc, iy^-(O) is a Hilbert space with respect to the inner prod- 
uct 

k 

(f,g)k,x ■= Yl V f,ge H k x (Q), 

j=0 

and C°°(Q) is dense in H X (Q) with respect to the norm ||.||fc,x induced 
by this inner product. The completeness and density assertions are 
proved in the same way as for ordinary Sobolev spaces, see e.g., in [3 
Theorem 2 in §5.2, Theorem 3 in §5.3.3]. 

Lemma 4.2. Suppose the hypotheses of Theorem M.SX If for each k G N 
the inequality 

(4.3) \\Bf\\ k < H/lkx, VB/Jerp), 

holds, where the constant in < does not depend on f , then the conclu- 
sion of Theorem holds. 

Proof. Suppose g G H X (Q). Since C°°(fi) is dense in H x (tt), there 
exists {fj} C C°°(Q) such that lim^oo \\fj — g\\k,x = 0; in particular, 
the sequence {fj} is Cauchy with respect to the norm ||.||fc,x- The 
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proposition in §2 in [12] says that Bfj G C°°(0), so (14. 3[) is applicable. 
Since (14. 3 p holds with constant independent of /, 

11-8// — Bf m \\k = \\B (fi — f m ) || < \\fi — f m \\k,X 
holds with constant independent of I and m, which implies that {Bfj} 
is a Cauchy sequence in H k (Q). Hence, there exists F G H k (Q) such 
that lim^oo \\Bfj - F\\ k = 0. We claim that F = Bg in H k (Q). First 
note that 

\\F-Bg\\ < \\F-Bfj\\ + \\Bfj-Bg\\ 
<\\F-Bfj\\ + \\fj-g\\ 

holds, and hence F = Bg in L 2 (Q). Moreover, since 

\(F - Bg^)\ < \\F - Bg\\ ■ ||^|| V ^ E C™({1), 

it then follows that (F - Bg } vp) = for all ip G C™(Q). Thus, all the 
derivatives of Bg up to order k exist in the distributional sense, and in 
fact equal those of F. Since F G H k (Q), this implies that F = Bg in 

□ 

The collection of estimates ( 14. 3 j) will be shown by induction on fc. 
We start with the proof of 

(4-4) P/||i<||/||i^ V/GC-p, 

i.e., the case k = 1 in (I4.3p . and break establishing (I4.4p into a few 
lemmas in order to separate the different elements of the proof. 

Lemma 4.5. For all f G C°°(f2) ; the inequality 

(4-6) II5/H, <pTB/|| + 11/11 

holds with a constant independent of f . 

Proof. Since Bf G 0(0) n C 00 ^), part (ii) of Corollary EH applies 
with k = 1 so that 

l|S/||?< ||Xfi/f+||5/|| 2 
holds. The boundedness of B in L? then yields (14.61) . □ 

To bring estimate (12.41) to bear, set if = Ndf and note that Bf = 
f — d*Lp by Kohn's formula (I2.5p . Also note that cp G P 0,1 (O), since N 
maps into Dom(<9*) and is globally regular. 

Lemma 4.7. For f G C°°(Q) and if := Ndf, the inequalities 

« Q{<p,<p) < \\f\\ 2 , 
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w i^ii 2 + e; = iIi^ii 2 + ii^ii 2 <ii/ii 2 , 
r im^iw+ii/ii 2 

hold with constants independent of f . 

Proof. Part (i) follows from 

Q(<P,<p) = \\d<p\\ 2 + \\d*<p\\ 2 = \\f-Bf\\* 

and the orthogonality of B. Since (i) holds, (ii) follows from (12. 3p . 
Lastly, applying part (i) of Corollary 13.61 to each component of ip and 
using (ii) yields (iii). □ 

The vector field X does not preserve membership in V 0,1 (Q). Thus 
a slight modification of X is needed before proceeding with the proof 

of gap. 

Lemma 4.8. There exists an operator T such that 

(i) Tu E V°'\tt) whenever u E £> 0>1 (^) ; and 

(ii) || (X - T)u\\i < \\u\U for u E A 0,1 (n) for % E {0, 1}. 

Proof. Since X is tangential to &fl, it follows from (12. 2p that 

n n 
3=1 3=1 

holds on bfl. Thus, defining 

n 

(4.9) Tu:= Xu + dr -x^Xir^Uj VueA ' 1 ^) 

for x defined as in (13. ip . yields that Tu E TJ 0,1 (Q) whenever u E 
T> 0,1 (Vl). Moreover, on the first order level T acts componentwise on u 
and equals X. Since 



\\(X -T)u\l t = J2\\r- Zk xJ2 X ^>3 

k=l j=l 



< 



clearly holds for i E {0, 1}, the proof is complete. □ 

The next result shows that only a single directional derivative of ip 
is needed to control XBf. 

Lemma 4.10. The inequality 

(4-11) ii^/ii 2 <ii^ii 2 + ii/ii1x 

holds, with constant independent of f E C°°(Q). 
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Proof. Since 

\\XBf\\ 2 = (Xf,XBf) - (Xd*<p,XBf), 
the (sc)-(lc) inequality gives 

\\XBff<\\Xff+\(Xd*<p,XBf)\ 

< \([X,0]<p,XBf)\ + \{0X<p,XBf)\ + \\Xf\\ 2 
(4.12) < ll^llx ■ \\XBf\\ + \&X<p,XBf)\ + \\Xf\\ 2 . 

Furthermore, 

| (tiXtp, XBf) | < | (d*7>, XBf) \ + \(&((X-T)<p), XBf) \ 
<\{T V MBf\ + \\(X-T) V \\ l .\\XBf\\ 
<|(7>, [d,X]Bf)\ + \\iph-\\XBfl 

where the last step follows from Bf G 0(Q) and (ii) of Lemma 14.81 
Inequality (14.61) then implies 

\{#X<p,XBf)\<\\<p\\ l .{\\XBf\\ + H/ll). 

Substituting this into (14.121) yields 

ll*5/|| 2 < IM|i.(||xs/|| + 11/11) + ||/||?^. 

Since (iii) of Lemma 14.71 together with (ii) of Lemma 14.81 imply that 

IMI?<IM 2 + ||/|| 2 , 

the desired ( 14.111) follows. □ 
To complete the proof of (14.41) . it remains to establish the following 
Lemma 4.13. For f G C°°(fi) and <p = Ndf , the inequality 
(4-14) Ml 2 < ||/|| 2 iX 

holds with a constant independent of f . 
Proof. For any e > 0, (12.41) implies 

\\Tcp\\ 2 <eQ(T^Tcp) + C(e) \Tipf_, 
<eQ(T^T<^) + Ci(e)|M| 2 

(4.15) < e [\\dT v \\ 2 + \\3*T V \\ 2 ] + C 2 ( e )||/|| 2 , 

where Lemma 14.71 (ii) is applied in the last line. The two terms in the 
bracket expression will be estimated separately. 



14 A.-K. HERBIG & J. D. MCNEAL 

The operator T has only been defined on (0, l)-forms. Thus, to 
commute 3 (and 3*) by the leading term of T, we switch back to X. 
That is, 

\\dT V r<\\dX V f+\\d{{X-T) V ) || 2 . 
By part (ii) of Lemma 14.81 it follows that 

\\8((x-T)p) || 2 <|MI 2 , 

while dtp = gives 

\\dXtpf = \\[d,xM 2 <Ml 

It then follows from (iii) of Lemma 14.71 that 
(4-16) ||^|| 2 < ||Xv,|| 2 + ||/|| 2 . 

The estimates when commuting (the leading term of) T past 8* are 
slightly different: 

ll^|| 2 <||^|| 2 +||^(X-TV|| 2 

<||^|| 2 + |M| 2 , 

where the second estimate follows from part (ii) of Lemma 14.81 Com- 
muting X by d yields 

ll^f < |p,x]<^|| 2 + ||x^|| 2 < |M| 2 + ||x9Vf 

so that 

ll^|| 2 < |M| 2 + ||X(/-5/)|| 2 
(4-17) <\\X<p\\ 2 + \\f\\ 2 +\\X(f-Bf)\f 

by (iii) of Lemma \A .71 For the last term in (14.171) . Lemma \A. 101 implies 



||X/|| 2 +||X5/|| 2 <||T^|| 2 H 



i,x- 



Combining (14. 16j) and (14.171) and using (ii) of Lemma 14.81 to re- write 
the terms involving X<p, we have 

Q(^,T^)<||T^|| 2 + ||/|| 2 iX . 

Returning to (I4.15P and choosing e small enough to absorb ||7V|| 2 into 
the left hand side gives the claimed estimate (I4.14p . □ 
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It remains to show that (14.31) holds for k > 1. Let k > 1 be a fixed 
integer, and suppose that 

(4-18) \\Bf\\ e <\\f\kx V/gC^H) 

holds for all £ < k — 1. The initial step of the proof that 
(4.19) \\Bf\\ k <\\f\\ k>x VfeC°°(Tl) 

holds is the same as when k — 1. 
Lemma 4.20. For all f G C°°(f2) i/ie inequalities 

\\Bf\\ k <\\Bf\\ k ^ x <\\X k Bf\\ + \\f\\ k ^ x 
hold with constants independent of f . 

Proof. The first inequality holds by part (ii) of Corollary 13 . 61 since Bf G 
0(Vt) fl C°°(fi). The second follows from the induction hypothesis 

TO. □ 

The new issue for k > 1 is to verify that only derivatives involv- 
ing X appear in the (essential) terms occurring when the higher-order 
operator X k is passed by B. The following two lemmas will be used. 

Lemma 4.21. Let A and B be differential operators of order a and b, 
respectively. Set 

C l= [...[[A,B},B],...,B], Ci = [£,...,[£, [A, £]]...]. 

V v ' V v ' 

i commutators i commutators 

Then both Ci and Ci are of order a + i(b—l) . Moreover, for any m G N 

m— 1 / \ m—1 * \ 

Proof. The conclusion follows by induction on ra in a straightforward 
manner. □ 

Lemma 4.22. The vector field X and the operator T as defined in 
( BSD safe/?/ 

m—1 

(4.23) ||(X--T-) W || 1 <X;P«|li 
as well as 

in 

(4.24) IIX'^II^^TIIT"^ 

e=o 

for all u G A 0,1 (fi) and m G N wift a constant independent of u. 
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Proof. Inequality (I4.23[) for m = 1 is (ii) of Lemma 14.81 Suppose that 
( I4.23P holds for any m < j for some j > 1. Then 

\\(X j -Ti)u\\ x < || (X^ 1 -^'- 1 ) Xu\\ x + \\Ti- l (X -T)u\\ x 

e=o 

by the induction hypothesis. Writing T £ (Xu) = T e+1 u + T e (X — T)u, 
it follows that 

j'-i i-i 
(4.25) || - T 7 ) «|| x < Mi + E ll T '( X " T Hli 

1=0 1=0 

holds. Lemma \4. 211 applied to the second term in (I4.25P and the induc- 
tion hypothesis yield 

£ ||T< (X - T) ttHj < \\(X - T)T*u\\ x + || [T\X - T] u^} 
e=o i=o 

£=0 

Hence (14.231) has been proved. Inequality (I4.24p follows straightfor- 
wardly from f l423|) after writing X m = (X m - T m ) + T m . □ 

As in the case k — 1, the form <p = iVd/ is used to pass X by 
I? in two steps. The next result, and extension of Lemma [4. 7\ collects 
estimates on the derivatives of ip that arise in the commutation process. 

Lemma 4.26. For f G C°°(fi) and <p = Ndf , the inequalities 

(i) Q(T>,T»< \\ff m , x , _ 

(ii) \\T m vf + EU ll^ T >ir + F T >H 2 £ ll/IIIU 

(iii) < ||T-+V|| 2 + \\f\\ 2 m , X 

hold for all m G {0, — 1} ; wift a constant independent of f . 

Proof. In the case of m = 0, Lemma 14.261 corresponds to Lemma 14.71 
Suppose (i)-(iii) hold true for all m < j for some j > 1. Then 

Q (TV, TV) = ||<9TV|| 2 + ||^TV|| 2 

< n<9xvii 2 + n^vir + ii - hi? 

< ii^xvir + n^vir + e ii T viii 

1=0 
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by (I4.23p . Next, commuting X by 8 and •& yields 

||<9XV|T+ II^VlT % \\X j d* V \\ 2 + \\[d,X j ] y?|| 2 + \\[#,X j ] tp\ 



|2 

i-i 



< l|xvir + iix^/ii 2 +^||xvn;, 

1=0 

where in the last step Lemma S]2T] was used. It now follows from (I4.24p 
that 

i-i 

(4.27) Q (T j ip, T j ip) < ||XV|| 2 + ||X^/|| 2 + ]T ||TV||' 

e=o 

The induction hypothesis on (ii) and (hi) and (I4.18P complete the proof 
of (i) for m = j. The remaining parts, (ii) and (iii), are shown as in 
Lemma 14.71 □ 

Lemma 4.28. For f E C°°(0) and (p = Ndf , the inequality 

\\X k Bf\\ 2 <\\T k V \\ 2 + \\f\\l x 



holds with a constant independent of f . 

Proof. Using arguments analogous to the ones preceding (14.121) . with 
X k Bf in place of XBf, it follows that 

\\X k Bf\f < \\X k f\\ 2 + \(X k d*<p,X k Bf)\ 

(4.29) < ||XV|| 2 + | (tfXV, X k Bf) | + | ([X fc , <%, X k Bf) \ . 

For the last term in (I4.29p , apply Lemma 14.211 followed by (I4.24p to 
obtain 

fc-i fc-i 
|([X fc ,^,X fc i?/)| < II^VIL ■ \\X k Bf\\ < £ I^VIL • 

For the second term in (14.291) . proceeding analogously to the arguments 
subsequent to (14.121) it follows that 

\{&X k (p,X k Bf)\ < \ (8*T k V ,X k Bf) \ + \\(X k -T k ) v?|| 1 ■ \\X k Bf\\ 



k-l 



<\\T k <p\\-\\Bf\\ k + Y,\\T t <p\\ 1 -\\X k Bf\\ 



Lemma 14.201 and part (iii) of Lemma 14.261 then yield 

ll^/ll 2 <i|TV|f + imiLx • 



□ 

The following result concludes the proof of (I4.19p . 
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Lemma 4.30. For f G C°°(fi) and ip = Ndf , the inequality 

\\T k ^<\\f\\lx 
holds with a constant independent of f . 

Proof. For e > 0, the compactness estimates (12.41) gives 
||TV|| 2 < eQ (T k <f,T k ip) + C(e) \T k V \\ 



<eQ (TV,rV)+Ci(e) 



2 

k-l.X 



by (ii) of Lemma 14.261 It was shown in the computation leading up to 
fl4T27j) that 



fc-i 

q (rV, TV) < \\x k f\\ 2 + \\x k Bff + ]T ||tV||' 

£=0 

<ll/H 2 fe ,x + ||^/|| 2 

holds, where in the second estimate (iii) of Lemma 14.261 was used. 
Applying Lemma T4.28I and then choosing e > sufficiently small yields 
the claim. □ 



5. Remarks 

The spaces H X {VL). Let Vt C C n be a smoothly bounded domain, r a 
defining function for f2. For X as in (11.21) . define 

oo 

flf (O) = f) fl* (O). 

fc=0 

If f2 satisfies the hypotheses of Theorem ll.3[ then the latter and the 
Sobolev embedding theorem imply that the Bergman projection maps 
H x (Vi) to C°°(fi) fl 0{Vl). That this is an improvement over the result 
by Kohn and Nirenberg [T4"j Theorem 2]) can be seen by examples 
similar to the one subsequent to Theorem 11.31 for given g G C°°(Q) 
and a > — |, set 

f(z) = (-r(z)) a g(z). 
Then, since a > — |, / G L 2 (Q). Moreover, the identity 

X k f(z) = (-r(z)) a X k g(z) 

yields / G H X (Q) for all k G N. However, for a ^ No and g not 
identically zero on bfl, it follows that / H e (Q) for £ G N with £ > 
a + \. Thus / G \ C°°(n) while Bf G C 00 ^). 
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Theorem 11.31 gives a collection of different estimates since the spaces 
H^(Q) depend on the choice of X (i.e., on the choice of the defining 
function). E.g., consider the upper half plane 

(5.1) H = {(x,y) G K 2 : r(x,y) = -y < 0} 

= {(x, y)eR 2 : p(x, y) = -{l + x 2 )y < 0} 

and the vector fields X and X, defined by ( 11. 2\\ for r and p respectively, 

Let f(x,y) = ysin(y~ 3 )x(x,y) where \ £ C%°(W) is identically 1 near 
the origin. Then / G L 2 (H) since | sin(?/~ 3 )| < 1 for y > 0. Further- 
more, it follows from the equality 

X k f(x, y) = y sm(y- 3 )X k X (x, y) V k G N 

that / G #|(H) for all k G N, and hence / G iff (H). However, an easy 
calculation shows that X(sm(y~ 3 ))yx(x, y) fails to be L 2 -integrable 
near the origin while X(yx{x, y)) sin(?/ _3 ) G L 2 (M). Thus / ^ i?~(E[). 

Estimates for other vector fields. The essential property of the 
vector field X for the proof of Theorem 11.31 is 

(5.2) T(bQ) = span{L 1; . . . , L n , L u . . . , L n , X} 

The tangentiality of X ensures the construction of T in Lemma 14.81 
as well as the validity of the various integration by parts arguments 
whereas the spanning property in (15. 2[) guarantees that all derivatives 
can be converted to X and barred derivatives when measured in L 2 - 
see Proposition 13.41 and Corollary 13.61 

As only property (I5.2p is essential, Theorem 11.31 holds also for any 
tangential vector field Y, satisfying (15.21) . in place of X, e.g., 

n 

Y = aX + J2 {bjLj + CjLj) , 

3=1 

where a,bj,Cj G C°°(fi) and a(z) ^ for all z G bQ. If the function 
a vanishes on bQ, then property (15.21) is violated and in fact both 
Proposition l3.4l and Corollary 13. 6l fa.il to be true. The following example 
shows that the tangentiality of Y is also essential. 
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Example. Consider the upper half plane H as in ( 15. lj) . For a given 
constant a G (— 1,0), let 

/0,y) = l^rx(^, 2/), 

where x £ C£°(H) is non-negative and satisfies \ = 1 on R = [— 1, 1] x 
[0, 1]. Then both / and its normal derivative, -§^f(x, y) = \x\ a x y (x, y), 

belong to L 2 (H). However, -§^Bf fails to be square-integrable near the 
origin. In the following, we give a short sketch on how to prove this. 
First recall that 

Also, note that it suffices to show that the imaginary part of -§-Bf is 
not in L 2 (D e ) , where D e = {(x,y) G 1R 2 : y G (0, e], < x < ey}, for 
some positive e < \. A straightforward computation shows that 

oz 7r J R [z — iyj c> 



so that 



Write w = u + iv and integrate with respect to v to obtain 
d 1 

OZ ITT 

n J—i \((x — u) + zy) 



5 = i- / |u| a ((x - u) + m/)~ 2 du mod L 2 (A) 

u l 777 modL 2 (A)- 



Therefore, 

Im f ^-(Bf)(z)] = -- I \u\ a ( x - u ) 2 -y 2 du mod L 2f D ) 

7 W-i ((x- M ) 2 + y 2 ) 2 1 ; 

=:I(z) modL 2 (D e ), 

and it remains to be shown that I ^ L 2 (D t ). It follows from a coordi- 
nate change in the x-variable that 

(l(z)) 2 dV(z)= f [ y \l(x,y)f dxdy 

0-(ty,y)) 2 y dt dy. 



D e JO JO 



JO 
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Another change of variable (in the ^-coordinate) yields 

t/, v 1 f 1 , , a y 2 -(ty-uf 
l{ty,y) = - / \u\ jji ^- — ^du 



tJ-i ((ty~u) 2 + y 2 ) 



T 



tt ( (t- r) 2 + i r 

However, some further calculation shows that y) is strictly positive 
if t and y are sufficiently close to 0. Hence, for sufficiently small e > 
there exists a constant C > such that 

(I(^)) 2 dV{z)>C f fy 2a - 1 dtdy, 

D e JO JO 

which does not exist since a < 0. Therefore, jfBf is not square- 
integrable on H although / G if^_(H). 

9y 



Appendix 

On the ball in C n , the Bergman operator commutes with the vector 
field X defined by (11.21) . This fact seems likely to be known, especially 
to mathematicians working in Lie theory, but the authors were unable 
to find a statement of this result in the literature. 

Let D = {z G C n : r(z) = £? =1 \zj\ 2 - 1 < 0} be the unit ball. The 
Bergman kernel can be explicitly computed on D [21], resulting in the 
expression 

B f( z ) = -n\ n f H \w dv ^ f G L ^ D ^ z g d > 

7T n J D (1 - [Z, W)) n+L 

for the Bergman operator B on D. To clarify the (elementary) argu- 
ment below, subscript the vector field X, defined by (11.21) . with z or 
w to indicate whether X acts on the free variables z or the integration 
variables w. Since 

" d n d — 

X z ((z,w)) = J2 Z jg^, i( Z ' W )) = J2™lQ—. (( Z > W ^ = Xw W ^ ' 

it follows that for / G C°°(D) 



i=i ' ~' J i=i 3 
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Since X is self-adjoint, integration by parts then yields 

Xz Bf(z) = — I Xv, y^ dV(w) = B(Xf)(z). 

Thus, [5,X] = on C°°(D). 
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